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Abstract. In this paper we discuss the meaning of the Schnakenberg formula for 
entropy production in non-equilibrium systems. To this end we consider a non- 
equilibrium system as part of a larger isolated system which includes the environment. 
We prove that the Schnakenberg formula provides only a lower bound to the actual 
entropy production in the environment. This is also demonstrated in the simplest 
example of a three-state clock model. 


1. Introduction 


With the development of stochastic thermodynamics Si on the basis of nonequilibrium 
statistical physics (5]-7| the study of the thermodynamic implications of coarse-graining 
attracted increasing attention |8-18 . In this field Markov jump processes are used 


to model a large variety of physical systems. Such models possess a discrete set of 
possible configurations (microstates) s G Q sys and evolve dynamically by spontaneous 
uncorrelated jumps between the configurations according to certain transition rates 
w s ^. s f. Whenever such a jump occurs the system is said to produce an entropy of the 
amount 


A Sf/n'i) In 


w x 


KV- 


( 1 ) 


in the environment |2|. This formula for entropy production, which goes back to a work 
by Schnakenberg (l9]| in 1976, is nowadays used throughout the whole literature (see e.g. 
Refs. 


20— 241). But where does this formula come from? Does it describe the actually 


generated entropy outside of the system or does it just have the meaning of a lower 
bound? The aim of this paper is to shed some light on these fundamental questions. 
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The original approach taken by Schnakenberg is quite remarkable. He first points 
out that the master equation 


^P s (f) = ^ P s/ (t)w s '-> s 

s' 


J2 p s(t) w s—>s' 

S' 


( 2 ) 


for the configurational probabilities P s (t) is formally equivalent to a chemical rate 
equation 

(3) 

3 


for particle concentrations [A 7 *] with an appropriately chosen stoichiometric matrix Sij 
and a linear rate function /. Thus, by identifying the probabilities P s of individual 
microscopic configurations s with the concentrations [X j] of different chemical species 
X\ he created a fictitious chemical reaction which evolves formally in the same way 
as the original master equation. Building such a chemical system is of course only 
a thought experiment because in practice a complex system like a gas could easily 
have more than 10 10 “° (1 different microscopic configurations, each of them corresponding 
to a different chemical species. Nevertheless, such a chemical reaction, if realized, 
would generate a certain entropy which can be quantified by using standard methods 
of equilibrium thermodynamics. Schnakenberg suggested that this chemical entropy 
production, when properly normalized, coincides with the actual entropy production of 
the non-equilibrium system in its environment. 


Some time ago we suggested that the Schnakenberg entropy production is not 
an equality but only a lower bound for the actual entropy production in the 
This claim was first proven by Esposito 26 in a thermodynamic 


environment 


25 


setting and then developed further in the context of hidden entropy production 27,28 


In this approach the subsystems are always in contact with heat baths which allows one 
to quantify the corresponding energy, work, heat transfer, and entropy flow. 


Here we present an alternative proof which is to a large extent independent of 
thermodynamic notions. As in previous works we embed the laboratory system into 
a larger isolated (closed) system which can also be modeled as a Markov process. 
This environment may be out of equilibrium as well, and neither the system nor the 
environment are coupled to other external heat baths. Using this setup we argue that 
that any nonequilibrium system may be thought of as being part of a larger equilibrium 
system on its way into the stationary state. Although we use the same concept of coarse- 
graining as in Ref. 26 , our approach is solely based on microscopic configurations and 
transitions without assuming energy conservation. Thus the proof does not invoke the 
notions of energy, heat, work and temperature, showing that the suggested Schnakenberg 
inequality is to a large extent independent of the first law of thermodynamics. We also 
prove that the inequality becomes sharp in the limit of instantaneous equilibration of 
the environment after each jump in the laboratory system. 
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The derivation is based on the assumption that the ’total system’, consisting of 
laboratory system and environment, is isolated and can still be described by a Markov 
jump process. As such, it is expected to relax into a Gibbs state of maximal entropy, and 
this requires the transition rates between microscopic configurations to be symmetric. 
This assumption could of course be questioned. As an isolated system, quantum 
mechanics tells us that the ’total system’ evolves unitarily, preserving entropy without 
spontaneous jumps. This contradiction, which touches the very foundations of statistical 
mechanics 29 will not be addressed in this paper, we rather assume that a description 
in terms of Markov processes still holds and study the resulting consequences. 


The paper is organized as follows. In the next section we introduce notations 
and outline the strategy of embedding a nonequilibrium system in a larger isolated 
system. Then in Sect. [3] we compare the Schnakenberg formula and the actual entropy 
production numerically and demonstrate the embedding in the example of a simple clock 
model. Finally, in Sect. [4] we prove that Schnakenbergs entropy production provides 
a lower bound to the actual entropy production which becomes sharp in the limit of 
instant equilibration in the environment. 


2. Embedding a nonequilibrium system in the environment 


Let us consider a physical system, from now on called laboratory system, which is 
modeled as a classical stochastic Markov process. It is defined by a certain space of 
classical configurations s G Q sys , where we use the symbol ’s’ to remind the reader 
that this configuration refers to the laboratory system. As before, let us denote by 
P s (t ) the probability to find the system at time t in the configuration s, normalized by 
^2 s& Qsys P s (t) = 1- In a Markov process this probability distribution evolves according 
to the master equation (j 2 |, which can also be written as 

^ p s(t)= E - JsMtj) , (4) 

s’eft s y s 


where J s ^. s i(t) = P s (t)w s ^. s ' is the probability current flowing from s to s'. For simplicity 
we shall assume that the system is ergodic. 


According to Kolmogorovs criterion 30 , which implies detailed balance in the 


stationary state, the rates of an equilibrium system are known to obey the condition 


n 


W 


Si - 1 


W 


Si+l^Si 


1 


(5) 


for all closed paths 7 : Si —>• s 2 —>■ Si in the configuration space. The 

path independence allows each configuration s to be associated with a dimensionless 
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( 6 ) 


where So is a reference configuration and V so its reference potential. As can be verified 
easily, the stationary probability distribution, normalized by the partition sum, is then 
given by 

Pf at = lim P s (t) = -e~ K . (7) 

t—> OO Zj 

This stationary state is known to obey detailed balance, meaning that the probability 
currents cancel pairwise: 


Tstat 


jstat _ TSU 

J J s'^fS 


( 8 ) 


The form of the potential depends on the way in which the system interacts with the 
environment. For example, in the canonical ensemble we just have V s = /3E S . 


A special situation emerges if the system is isolated , meaning that it does not 
interact with other systems or the environment. As discussed in the introduction, we 
start with the premise that it still makes sense to model such a closed system by a 
Markov process. Starting from this premise we are forced to assume that all rates of 
an isolated system have to be symmetric (w s -> s i = w s >^ s ) since otherwise the Gibbs 
postulate would be violated. Although this reasoning is made on a classical basis, it 
resembles the well-known Stinespring theorem 31 in the quantum case, stating that any 
non-unitary open system can be thought of as being part of a larger unitarily evolving 
system. 


Open system embedded in the environment 

The rates of a genuine non-equilibrium system do not obey the Kolmogorov criterion (J5]) , 
meaning that it relaxes into a non-equilibrium steady state (NESS) that violates detailed 
balance. In the following we argue that we can always think of such a system as being 
embedded into a larger isolated system, called total system. This provides a clear setting 
for the study of entropy production. 

Let us assume that this total system (consisting of laboratory system and 
environment) can be described in the same way as the laboratory system itself, namely, 
as a Markov process in terms of certain configurations c e Q tot , probabilities P c (t), and 
time-independent transition rates ?n c _> c /. The configuration space of the total system 
may be incredibly large and generally inaccessible, but if the total system is assumed 
to be isolated, hence the corresponding transition rates have to be symmetric: 

Wc — yd ^c'—>c • 


( 9 ) 
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Figure 1. Schematic representation of the configuration space of a system embedded 
in the environment. 

The laboratory system is part of the total system. As such, any configuration c E CL tot of 
the total system will correspond to a particular configuration s G Q sys in the laboratory 
system. This mapping 

7 r : c e->• s — 7r(c) (10) 

is of course not injective, i.e., for a given system configuration s there are usually many 
possible configurations c of the total system, as sketched in Fig. [T[ 


Coarse-grained master equation 

For a given projection s = 7r(c) it is clear that the probabilities of the laboratory system 
can be obtained by coarse-graining 

p.(t) = 'Em), (ip 

cEs 

where the sum is understood to run over all c with 7r(c) = s. Similarly, it is clear that 
the corresponding probability currents sum up as well: 

Js-+At) = ( i2 ) 

cEs c'Es' 

Thus, if the total system is assumed to evolve according to the master equation 

^Pc{t) = J2 (-w*)- -w*)), (i3) 

c'£fl tot 

it is easy to show that these coarse-grained quantities defined in (fll])-(|l2| obey the 
master equation Q . In other words, a master equation in the total system gives rise to 
a projected master equation in the embedded laboratory system. 
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The coarse-grained currents and probabilities allow us to define effective rates in 
the laboratory system: 


'UJs—ts 1 if) 


Js—ts' if) 

p.lt) 


(14) 


Unlike the rates w c ^. c i of the total system, which are time-independent and symmetric, 
these rates are generally non-symmetric. Moreover, they do not necessarily obey the 


Kolmogorov criterion, and they may also depend on time 25,26 


Physical interpretation 


As already mentioned, we assume the total system to be isolated, implying that the 
transition rates w c _> c / are symmetric. Thus, if the total system is finite and ergodic, 
it will nevertheless end up in a uniformly distributed state where J c _> c / = Jd-*c- This 
implies that the laboratory system will eventually reach a stationary state obeying 
detailed balance. 


However, before reaching this stationary state (meaning that the environment is still 
relaxing towards equilibrium) the laboratory system considered by itself may be found 
to violate the Kolmogorov criterion, meaning that it is genuinely out of equilbrium. The 
apparent contradiction that it will end up in a detailed-balanced equilibrium state can 
be reconciled by observing that the effective transition rates (14) are generally time- 
dependent: When the total system finally equilibrates the rates change in such a way 
that detailed balance is restored. 


Thus, if the total system is finite, a possible nonequilibrium dynamics in the 
laboratory system can only be established for a transient period. However, if the 
environment is infinite, then it may be possible to keep the laboratory system out 
of equilibrium for infinite time, allowing the possibility of nonequilibrium steady states. 

As we will argue below it is also possible to look at the problem in opposite direction, 
meaning that for a given nonequilibrium system we can always find a total system 
with symmetric rates which generates this dynamics. In other words, for a given set 
of effective rates in the laboratory system we can always ’engineer’ an artificial total 
system which produces them. In the following section we will give an explicit example 
of such a construction. 


Entropy 

As usual, the entropy of the laboratory and the total system are defined by 

S sys (t) = - J2 Ps(t)\nP s (t), S to \t) = ~Y, Pc(t)lnP c (t) . (15) 

seQ sys c£fi tot 
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Using the master equation (|13|) it is straight forward to calculate the entropy production 

(16) 


of the laboratory and the total system: 

S sys (t) = (t )) In P a (t) , 

S s' 


- P c ,{t)w c ^ c ) In P c (t). 


(17) 


The actual entropy production of the total system (17) involves the probabilities P c {t) 


and rates w c ^. c > of the total system which are generally not accessible. However, 


according to Schnakenberg 19 we can nevertheless quantify the total entropy 


production solely on the basis of the probabilities P s (t) and the rates w s -> s >(t) of the 
laboratory system by means of the formula 


= In 


s,s' 


Js — ys' (t) 

J s' — (t) 


(18) 


Note that the entropy production according to Schnakenberg (here denoted by the 
subscript ’O’) does not necessarily coincide with the real entropy production in ( Jl7| ). 
This can be seen in the extreme example where the laboratory system consists only of 


a single configuration. Here Sq 3 * vanishes, whereas S tot in Eq. (17) may be nonzero. As 


we will argue below, we expect them to be related by the inequality S tot > S “ which 
reduces to an equality in the limit of instant equilibration in the environment. 


3. Numerical results 

3.1. Simulation of a total system with random properties 

To test the proposed inequality we modeled the total system by an artificial Markov 
process, where N tot configurations are fully connected by randomly chosen rates. 
Moreover, we introduced a subsystem by defining an random projection n to a smaller 
set of system N sys configurations. Solving the master equation of the system numerically 
we compute the corresponding entropies and study the entropy production. 

The numerical analysis was implemented as follows. A vector of size N tot was set 
up containing the probabilities P c {t) of the total system. This array was then filled 
with random numbers and normalized, defining the initial probability distribution of 
the total system. Then every entry was randomly assigned to a configuration s of the 
laboratory system. By summing over all probabilities P c (t) mapped to the same s the 
probability P s (t) = J2 C £s^ > c ('') can determined. Finally the setup was completed by 
generating random symmetric rates w c _>. c / = w c ^ c between all array entries. 

Solving the master equation with a vectorized Runge-Kutta algorithm we computed 
the Shannon entropy of the total system before and after each time step. The change 
of this entropy is considered as the actual total entropy produced in the time interval. 
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Figure 2. Left: Temporal evolution of the actual entropy production (red) and the 
prediction by Schnakenberg (black) in a random Markov process with N to t = 1000 
configurations mapped to N sys = 200 system configurations. Right: If one adds an 
artificial instant equilibration of the environment after each update, the two curves 
coincide. 


As the Schnakenberg formula generates a value for the time derivative of the entropy, 
the corresponding entropy production was calculated via the trapezoidal rule. 

As can be seen in Fig. [2j the produced entropy for this random system is 
obviously at all times larger than the Schnakenberg entropy production. In the 
completely random initial state there is a difference which decreases as the system 
relaxes towards equilibrium. We repeated this calculation under various conditions, 
obtaining qualitatively similar results. This suggests that the inequality 

S tot (t) > Sg*(t) (19) 

holds in any system, i.e., the Schnakenberg formula provides a lower bound of the actual 
entropy production. 

In a second numerical study we equilibrated all subsectors of the total system 
instantly after each update, meaning that the P c (t) for all c belonging to the same 
system configuration s were forced to coincide. As shown in the right panel of Fig. [2] 
one obtains a perfect coincidence. This suggests that the inequality becomes sharp in 
the limit of instant equilibration. We will come back to this point in Section [IJ 


3.2. Construction of the environment of a clock model 

In order to demonstrate that for a given nonequilibrium system we can ’engineer’ an 
appropriate embedding into a larger environment, we consider a class of cyclic models, 
where the configurations are connected with asymmetric rates. The simplest case is a 
three-state clock model, as shown in Fig. [3j 

Since the clock model does not obey detailed balance, it is obviously out of 
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Figure 3. Cyclic clock model with three configurations and asymmetric rates. The 
process jumps preferably in clockwise direction, leading to a non-vanishing probability 
current even in the stationary state. 


equilibrium. In the following we show that this dynamics can be generated by embedding 
it into a larger equilibrium system, i.e., we create a suitable model of the environment in 
such a way that the total system is isolated, having only symmetric rates. To this end 
we first unravel the cycle into a linear chain of repeating configurations 25 , as sketched 


in Fig. |4} As can be seen, each configuration on the chain corresponds to a number of 
configurations c in the total system, which means there are new three levels to view this 
model, namely, 


• the level of the clock model having only three configurations, 

• the corresponding linear chain of repeating configurations (unraveled states), and 

• the total system which allows for a large number of configurations for each unraveled 
state. 


On the linear chain the model performs a random walk that is biased to the right. 
In order to generate this dynamics, only neighboring sets of configurations in the 
environment are connected, as sketched in the Fig. [4] (the configurations within each 
column may be connected as well, which is not shown). Note that the configurations of 
the total system are all connected by symmetric rates. Thus, in order to create a bias 
on the linear chain, the number of configurations in the total system has to increase as 
we go to the right. In this way an entropic force will be introduced, dragging the system 
to the right. 

Enumerating the states on the linear chain by an index i, the ratio of the rates 

- w - f 
w+- 

determines how quickly the number n* of configurations in each columns grows. For 
example, for r = 2 this number doubles from column to column, increasing exponentially 
as Hi = 2* _1 . Moreover, the symmetric rates in the total system have to be chosen in such 
a way that the probability current along the chain remains constant. This also means 
that on the chain the symmetric rates of the total system have to be proportional to 

1/rii. 

If the linear chain was infinite with an ever-increasing n*, then the projected clock 
model would indeed rotate forever. However, on a finite chain the system will eventually 
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Figure 4. Interpretation of the cyclic process as a biased random walk on a linear 
chain. The upper box shows the corresponding configurations of the total system (see 
text). 


reach the right edge. When the edge is reached the effective rates of the laboratory 
system will change, leaving the non-equilibrium steady state and establishing detailed 
balance. 

3.3. Solving the master equation of a clock m.odel numerically 

In order to avoid the exponentially increasing number of configurations in the total 
system in a numerical analysis, we use the symmetry property that all configurations in 
a given column are equally probable. Therefore, it suffices to keep track of only one of 
them. In the end this probability has to be reweighted by n. 

We solved this problem numerically on a chain with N = 500 columns, starting 
with an initial probability distribution focused in the center. The numerical solution 
is then used to determine the actual entropy production and to compare it with the 
prediction by Schnakenbergs formula calculated on the level of the clock model. 

The difference between the two quantities is plotted in Fig. [5] As can be seen, 
the difference first decreases like y/t, which is expected for a diffusion-like process. 
The diffusion-like behavior can be explained by recalling the three different levels of 
description: 

• The Schnakenberg formula refers to the three-state configuration space of the 
laboratory system. After a short initial transient the configuration entropy becomes 
constant (H sys = In 3) and the entropy production in the environment saturates at 
a constant value S = \ In 2. 

• Contrarily, the actual entropy production refers to the level of the total system. 
It consists of two contributions. On the one hand the biased motion to the right 
contributes with a constant entropy production. On the other hand, the probability 
distribution broadens, giving an additional contribution to the entropy production. 
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Figure 5. Temporal evolution of the difference between actual entropy production 
and the prediction by Schnakenberg in cyclic model with 3 configurations and the 
rates = 2 and w = 1, modeled as a chain with length N = 500. 


This contribution is expected to scale as 1 j\ft. This explains the straight slope in 
the double-logarithmic plot in Fig. [5j 

Another notable feature is the pronounced peak in the figure which can be identified with 
the moment when the right edge of the linear chain is reached. Here the effective rates 
in the laboratory system start to change, leading to a sudden increase of the difference. 
As the system is further relaxing towards detailed balance both entropy productions are 
decreasing again which accounts for the final rapid decay after the peak. Throughout the 
whole time evolution the Schnakenberg entropy production is smaller than the actual 
one, confirming that it provides a lower bound. 


4. Analytical results 

In order to support that the Schnakenberg entropy production is in fact a lower bound, 
we proceed in two steps. First we prove that in the case of instant equilibration of the 
environment the Schnakenberg entropy production and the actual entropy production 
coincide. Then we prove that the Schnakenberg entropy production provides a lower 
bound to the actual entropy production. In the following sections we omit the time- 
dependencies of the variables introduced in Sect. [4] for ease of reading. 


Special case of instant equilibration in the environment 

Since the total system is isolated, the rates w c ^ c ' are symmetric. This allows the actual 
total entropy production to be rewritten as 

s t0t = ^ {PcWc-^C ~ Pc'Wc^ c )\nPc 

c£fl tot c'£fl tot 
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= y y, PcWc-^d in p c - y y p c jw cJ ^ c in p c 

cGfl tot c'€fl tot cGfl tot c'Gfl tot 

= E E P c w c ^ c i In P c - E E PcWc^d In P c f 

cGfl tot c'Gfl tot c'Gtt tot cGfl tot 

= Y Y P < w ^c> In . 

centot c'gntot c 

Using the map to the laboratory system the sums can be reorganized by 

s m = E E EE^ 1 ”^ 

sGfi sy3 s'£fi s y 3 c£s c'es> c 

Now let us assume that the environment equilibrates instantly, meaning that all 
probabilities P c belonging to the same sector s coincide, i.e. 


( 21 ) 


( 22 ) 


P c = Ps Vc e s , 


(23) 


where p s should not be confused with P s = -P c . Under this assumption Eq. (22) 
reduces to 

Ps 


S tot = y P ° ln ~ Y Y ’ 


s.s'g « s « s 
s^s’ 


Vs 


(24) 


cGs c'Gs' 


where the first sum runs only over different sectors (columns) because of the logarithm. 

Now we show that the Schnakenberg entropy production (16) leads to the same 
expression. Using Eq. ((121) we get 


QjtOt _ 


E J 1 Js—>s' 

tJ at —v o 


s,s'en s y s 

s^s' 


Y ln 

ef2 s « s V cGs c'Gs' / 

s^s’ 


'YhcGs Ec' gS ' Pc W c- 

Y2cGs Sc'Ss' Pc' w c 


(25) 


By using the assumption of instant equilibration of the environment and the symmetry 
of the rates in the total system we can further simplify this formula: 

Ps XjcSs 'Yhc'Gs' w ° 


sg* = E E E 1 hi n U 5 * 

,,U.. 'sPP I Ps' V.,, V,y e ,' 


s^s' 

E *>£EE 


s ,s'g n s v s 
s^s' 


VJ r — Pc' 


(26) 


cGs c'Gs' 


If we now compare (26) to (24), we see, that for instant equilibration (P c = P c i = p s 
for c, c! G s ) and symmetric rates in the total system the actual entropy production 
calculated using the Schnakenberg formula is equal to the entropy production calculated 
via Shannon formula and the master equation. 
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Now we prove that the Schnakenberg entropy production provides a lower bound to the 
actual entropy production. To this end we first define the function 


x 


h(x,y) = {x-y) In-, 

y 


(27) 


with x, y € R + . For x j- y this function is positive and zero otherwise. The Hessian 
matrix of h 


H 


8 2 h(x,y ) d 2 h(x,y) 

dx 2 dxdy 

d 2 h(x,y) d 2 h(x,y ) 


x+y 

x+y 

X 2 

xy 

x+y 

x+y 

xy 

y 2 


_^ , ,__ (28) 

dydx dy 2 

is positive semidefinite. This implies that h is convex, which in turn allows us to use 
Jensen’s inequality: 


y ^ yf) ^ h j y ^ ^v^ii y ^ / > 

i=1 i =1 


di> 0, J2 a i- (29) 


i=l 


i =1 


Furthermore one can easily see that h is homogenous, i.e., 
h y\ h(x,y) 


A’ A 


A 


(30) 


To describe the entropy production with Eq. (27) we need to rewrite Eq. (21) again, 
using the symmetry of the rates in the total system and the definition of the probability 
currents: 

S tat = Y Y ln^ 

CgOtot c ' £ ntot C 


E E P c w c ^ c ' In 

ce£i tot c'efi tot 

^ ^ ^ ^ Jc—>c' 1 ^- 

ce£i tot c'efi tot 


PC^C — ¥d 
Pc'Wc'^c 

J r — 


Jr!- 


(31) 


This can be further rewritten by switching indices providing us with the desired form: 

1,- - . . Jr 


S tot = Y Y M^o + Jc^c) lnf=^ 

CgQtoi c 'gn‘oi C 

= )(e E ■w-j^+E e 

\cef2‘ ot c'e fi toi c ~* c ce Q tot c'eO to 

= i(E E E E 

VceO tot c'e n tot c c'e£i tot ceO to 

= )(e E ^jr ~E E 

\ c efi tot c'en tot c ~^ c c'en tot cen to 


Jr _ ±d In 


Jr, 


Jr! —±r. In 


Jd - 
Jd - 


Jd—±c In 


Jc-^d 
Jr. — vd 


Jr‘ 
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E E ( Jc—¥c' Jd 


In 


J, 


c&Q tot c'en“ 


JcJ 


E E h j [Jc—¥d’> Jc> 


(32) 


ceO tot c'efi“ 


Rewriting Eq. (18) provides us with a similar result for the Schnakenberg entropy 
production: 

•d a —i. cf 


Qtot _ 

“ 


^ ^ ] jS—>s' In 


sefi s y s s'£fi s y s 


J^- 


Y, Y + -W) In Js " s ' 


sefi s v a s'efi’s’ 

1 
2 


Js'^s 


(e E ^ >» 7 ^+ E E 

Vsen^ S '£n s y s s ~^ s sen s ^ s s'e$2 s » ! 

(E E E E 

Vsen^ s'£fi s y s s ~^ s s'Gfi a y a sef! s s ! 

(E E E E 

\sen s « s s'efi s y s s ~^ s s'eO s « s sef2 s « ! 


2 

J X] ^ (J s ^-J s ^ s )ln Js ^' 


c/”c—>e/ In 


'Jg'—±g In 


t/”o'—ie In 




s—>s' 


J g/_ 

J q' - 


Js- 

J, 


Jg'~ 


sefi sys s'en sys 


J o' - 


1 


E E h^Js^rs'l Js 


(33) 


s£tt s y 3 s'£fi s y a 

r-h 


We now assume that the set 7r 1 (s) = {c : 7r(c) = s} is hnite for all s and let n s be 
the number of total system configurations c of which each laboratory configuration s 


consists. Using Eq. (29) with n — n s ■ n s >, a* = - and x, t = J c ^. c ', Vi = Jc'^c and 


summing over c E s and d E s' we get the following inequality: 

1 n s n s’ / ^ n s n s , n s n s , 

- ^ X/ h(Jc-^c', Jc'^c) > hi — ^ ^2 Jc^c'i — ^2 Yj 

cEs c'Es' \ cEs c'Es' cEs c'Es' 


(34) 


Taking - out from the right hand side using Eq. (30) and further simplifying by using 


Eq. (12) we obtain the following inequality: 


1 n a n s' / n a n s , n a n s , 

- X^ Yj h(j c -+c?, Jc'-tc) > —h | x^ Y< ^ c ^ c '> Y/ Y* ^ c 

cGs c'Gs' \ cGs c'Gs' cGs c'Gs' 


n a n I 


n a n i 


n a n i 


EE c—^d ? Jd—¥c) — ^ EE J C— »c' ) E E 

\ cEs c'Es' cEs c'Es' 


cEs c'Es' 


( 35 ) 
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We can now apply the sum over all s, s' G Q sys and the factor | to both sides of Eq. (35) 
and compare it to Eq. (32) and Eq. (33), which will result in the desired inequality: 

- k . n / 

1 


1 

2 


E E E E hfJ ‘ 

se£i sys s'efi s y s ces c'es' 


'? Jd—*c) ^ cy ^ ^ ^ ^ h(Js—>s'i Js r —ys ) 


seQ s y s s'e^y* 


> s^ 


(36) 


This completes the proof that the Schnakenberg entropy production provides a lower to 
the actual entropy production. 


5. Conclusions and outlook 

In this work we have tried to explain entropy production of nonequilibrium systems in 
the environment by embedding the laboratory system into a larger isolated total system 
without introducing the notions of energy conservation, work, heat and temperature. 
We have shown that the commonly accepted formula for this purpose found by 
Schnakenberg is only exact in the case of instant equilibration of the environment. This 
is not surprising since Schnakenberg himself derived this formula by using methods of 
equilibrium thermodynamics, implicitly assuming that the environment is arbitrarily 
close to equilibrium. 

The conjecture that the Schnakenberg formula provides a lower bound of the actual 
entropy production of the total system was proven in general and confirmed by a numer¬ 
ical investigation of a random Markov process. Furthermore we have given an analytical 
argument showing that the actual entropy production becomes minimal, and thereby 
equal to the one given by the Schnakenberg formula, in the case of infinitely fast equi¬ 
libration among the corresponding configurations in the environment. We have tested 
these Endings numerically by creating an artificial environment for a simple three-state 
nonequilibrium clock model. 
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